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The seasuresert of change in quasi-experisental 
educational research vas discassed. Probl^ns related to seasuring 
change exist to varying degrees in all research designs; these issues 
are less troublesose in experisental studies because the investigator 
can sasipalate the interest variables ^d observe their effects on 
other variables, neasuring change is sore difficult in 
quasi-experisental studies because the investigator lacks the freedos 
to aanipolate the variables. This study focused on issues of change 
associated sith the latter design. Specifically, this study utilized 
the non-equivalent control qroup desiqn, in which the results of one 
or tvo Pretests are available prior to the investiqation. Four 
Bodels* or solutions to the fan spread hypothesis, in vhich variables 
can i^e used to predict change, were cospared: (1) gains in standard 
scores^ (2) sinqle covariable analysis of covariance with estisated 
true scores: (3) qain scores adjusted for differential qrovth rates; 
and (4) saltiple fallible covariable analysis of covariance. Hethods 
(1) « 12) » and (3) vere found to be suitable when the pretest -post 
test correlation of individual qrovth vas unity, lihen this 
correlation vas iaperfect, aethods (1) ana (3) estisated the desired 
effect. (GDC) 
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Data Analysis Strategies for Quasl^xperimental Studies 
Where Differential Group and Individual 
Growth Rates are Assumed^ 



Stephen Olejnik 
Introduction 

Educational researchers are interested In studying Individuals who con-* 
tlnually change. This Interest in naturally changing entitles has raised 
soma difficult problems in measurement and analysis. Although considerable 
research has been devoted to tbls topic (McNemart 1958; Lord* 1956* 1958, 
1963; Berelter, 1963; Cronbach & Furby* 1970; Linn & Slinde, 1977), the 
problems remain unresolved. 

Problems related to measuring change exist to varying degrees in all 
research designs. These issues are less troublesome in exparljsental 
studies where the investigator can manipulate the interest variables and 
observe their effects on other variables. Measuring change is more dif- 
ficult in quasi-experimental studies because the investigator lacks the 
freedom to manipulate the * iriables. Thi£: study focuses on issues of 
change associated with the latter design. Specifically, this study util'^ 
izes the non- equivalent control group design (Campbell & Stanley* 1966) 
where results of one or two pretests are available prior to the investi- 
gation. 



This paper is a summary of a 1977 doctoral dissertation of the 
same title. Complete derivations of the formulas found in this report 
can be found in that dissertation* Michigan State University. 
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Ca&pbell and Boruch (1975) have detailed eeveral concerns which may 
ariae in the analyala and Interpretaton of qtiaal-experlmental data* Their 
work focuses on the Issue of bias In estiJoatlng treatment effects. Although 
several factors contribute to a biased estimate » the entire problem origin- 
ates from the fact that without randomization there are likely to be substan- 
tial differences between the Individuals in their initial statue on the out* 
comes to be assessed* While several strategies have been suggested to con- 
slder these differences when estimating a program's ef fectlveness^ Campbell 
and Boruch argue that these adjustment procedures often cannot eliminate all 
bias* The magnitude of the bias is related to two Issues: (1) specifying 
appropriate variables on which an adjustment can be made» and (2) selecting 
an appropriate model in which variables can be used to predict change. The 
second issue^ specifying the appropriate analytic models was of major concern 
In this study* 

Specification of Analytic Model 
Specifying the appropriate analytic model la dependent on how IndXvl^* 
uals change over tlme« Several resea hers have recently considered the 
issue of growth models (Campbell^ 1971, any, 1975j Bryk & Welaberg, 1977) • 

The Fan Spread Model 

Campbell has been concerned with the relationship between growth rates 
and estimates of treatment effects. He argues that initial differences on 
the outcome dimension Imply differential growth rates* This selection by 
maturation la presented In Figure 1; the lines represent group average per* 
formance over tlme« The labels for treatment -control are arbitrary* 
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Figure 1, The selection by maturation interaction: 
Increasing mean differences In achievement 
between comparison groups across time. 

Campbell further develops this theory ot differential growth rates and 
labels it the "fan spread hypothesis." The hypothesis states that along 
with the increasing mean difference between the compared groups, a pro- 
portional increase in the variance within the groups occurs. Figure 1 
can be modified to reflect the changing variance as shown in Figure 2. 
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Time > T 

Figure 2. The fan spread hypothesis: Increasing mean 
difference In achievement between comparison 
groups with a proportional Increase In the 
withln-group variability across time. 

The broken lines represent the Increasing range of achievement 
scores within the treatTsent and control groups over time* This 
relationship between the increasing mean difference and the 
within-group variance is represented as the formula: 



T>t ^c, 



*^t 



vhere: 



^3C^ *^^c ' population means on measure (X) 

' for the program and conrol groups 
respectively « at time t; 

: is the pooled wlthin-group standard 
deviation of the outcome measure 
at time t; 

K ; is a constant. 
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Tbu* the difference between group means relative to the pooled within- 
group standard deviation renialns constant over tlAe. Kote that parallel 
growth patterns between groups may also conform to Campbell's (1971) fan 
spread model If the wlthln-group variance remains constant across time. 

Previous discussions of growth models concentrate on differential 
growth rates between comparison groups and Ignore the Isatte of differen- 
tial growth rates within groups. Differences In growtL rites within 
groups can be conceptualized in at least two ways, as presented In Figures 
3 and 4. 



X 




Figure 3. The fan spread »iypothes1s with the linear nuxlel 
of w1 thin-group growth. 
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Time T 

Figure 4. The fan spread hypothesis with a non-linear 
oiodel of w1th1n*group growth. 

In each diagram the solid line represents the average growth rate 
for the group; the broken lines represent Individual growth rates. Figure 
3 presents vlthin-group growth rates generally associated with the fan 
spread hypothesis^ Vlthin-group growth begins at a common starting point 
while Individual growth rates differ across time* Thus» In any two sub- 
sequent points In time. Individuals maintain their relative positions with- 
in the groups 

Figure Uf on the other hand, represents a situation In which the 
group^s mean growth is linear but individual growth is not» Under this 
model an Individual's growth rate may vary over time, i»e», growth may 
occur in spurts, but group growth may be constants Both models can re^ 
suit in data^r^forming to Campbell ^s fan spread hypothesis, but the 
Implications they have for data analysis and treatment estimation differ 
substantially^ 



Given the fan spread model represents a valid conceptualization of 
how individuals and groups change over time in quaei-experloental studies, 
Campbell (1971) argues that current analytic strategies are inadequate In 
adjusting for the differential nature of growth. 

Yhc Gains in Standard Scores Strategy 

In response to Campbell's argument tha£ currenc analytic strategies 
Ina^Jequataly adjust for the fan spread model, several researchers have 
proposed new or modified techniques to resolve the differential grovrh 
problem. Kenny (1975) argues that given the fan spread model, an appro- 
priate analytic strategy Is what he calls standardized gain scores (also 
referred to as gains In standard scores). The fan spread hypothesis sug- 
gests increasing variability within groups across time. Kenny's approach 
counters this increasing variability by standardizing the pretest and 
post-test scores using the pooled within-group standard deviation at time 
1 and time 2, respectively. The treatment difference can be presented 
as: 

(Pv ) 

is the estlioate of the treatment difference estimated 
by the gains in standard score jstrategy; 

are the population means on the post- treatment meaaure (Y) 
for the program and control groups, respectively; 

are the population means on the prc-treatment measure 
(X) for the program and control groups, respectively; 

are the pooled within-group standard deviations of the 
pre'treatment and post' treatment measures, respectively. 



where : 

oy^Ox : 



U 



d 



The uBe of this strategy^ like that of raw gain scores* requlrea that the 
pre-treatment oeaaure be Identical to or a parallel fona of the post** 
treatment measure. 

Analysis of ^variance vlCh Estimated True Scores 

Another solution to the fan spread model was proposed by Porter & 
Chlbucos (197A). They suggest that the analysis of covarlance model Is 
appropriate for the differential growth rate situation if the covarlatt^ 
is perfectly reliable. Given that the covariate is fallible » then analysis 
of covarlance with the estimated true score of the covariate will ade* 
quately adjust for the fan spread model. Estimated true score analy&la 
of covarlance was originally developed by Porter (1967) as a solution 
to the single fallible covariate problem. 

Using Porter's procedure the program effect can be written as: 

<^S s ifi the estimate of the treatment difference computed by 
the true scovet analysia of coveriance strategy; 

3^ ^ ; la the pooled vlthin-group linear regression slope of y on 
y . A 

x; 

pjm ; is the reliability coefficient of the covariate and 
yyp» ^Vc* Mxp, Hkc are as defined previously. 

The similarity of thla eatlmate to that of atandardlzed gain scores pre- 
sented earlier Is clearly ahown with the following substitution; 



'y.x - Pxy 
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The estloate of the treatn^t difference can nov be written as: 

Assuming Individuals conform to the fan spread^ pre* treatment scores 
should predict post- treatment scores perfectly, except for c^asurement 
errors* Thu£: the ratio of the correlation between measures and the pre- 
test reliability Is equal to unity, 1« The estimate of the program 
effect provided by true score analysis of covarlance and gains in standard 
scores Is the same for fan spread data conforming to the first model of 
within-*group growth. This similarity Is only true for the linear growth 
model for individuals within comparison groups. 

When individuals within groups are growing non-llnearly the ratio 
of the correlation between measures and the reliability coefficient of 
the pretest does not equal unity« The effect estimated by the gains in 
standard scores and analysis of covarlance with estimated true scores 
is, therefore* dlfferer^t. The two procedures also differ in that the 
gains in standard scores approach assumes that the correct ratio of the 
standard deviations 1^^ known for the populacloni while estimated true 
score analysis of covarlance eatimates the parameter on the sample data« 

The Ad.justed Gain Score Approach 

Another solution which might be considered to adjust for the fan 
spread effect is the use of gain acores adjusted for differential group 
growth. The raw^galn- score strategy assumes that groups change at rela- 
tively equal rates, and that the only difference between the groups Is 
the initial status at the point of intervention or observation. 

The far A^£ead model allows that not only do the groups differ in 

er|c I s 
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thair pre*treatment performance levels t but also that the groups chaiige 
at different rates* Therefore, simple gain scores could be liiappropriate 
in light of the fan spread model. If the gain scores were adjusted for 
the differences between the groups^ growth rates^ an appropriate esti- 
mate of the treatment effects might be obtained* Such modification is 
possible if additional data collected prior to the point of intervention 
are available* 

To facilitate a discussion on development of the modified gain score 
procedure. Figure 5 aetalls differential achievement growth over time 
for a hypothetical program and control group without a treatment effect. 

Point of End of 




Time 



Figure 5* Differential growth rates considered over three 
points in time* 
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The horizontal axis T denotes time; the vertical axis W represents 
achievement. Three points are Identified on the time dimension; t^, 
t^. and t^. The vertical broken Hue at t2 indicates the point of 
intervention, while the dotted lines at t^ and t^ represent points In 
time prior to and at temtlnatlon of the intervention, respectively. The 
solid lines represent the linear regression of achievement on time for 
the program and control group populations. The points at which these 
regression lines intersect the broken vertical lines represent the average 
achievement level on the measure administered at time t. 

For example, (^2* ^xp^ represents the population mean on measure X 
for the program group at the time of Intervention. These solid lines 
can be defined in regression equations and used to predict the average 
group performance at any point in time. If, for example, group performance 
at t^ was of interest, the following equations night be used: 
My - ^ + ^p (t3 - t2) 

- ac + *'c Ct3 " 4) 

' c 

where! 

My My^ ; are the population mean performance on measure (Y) at time 
^* t^ for the treatment and control groups, respectively; 

ap^^^ * are the Intercept constants of the regression lines for 
the treatment and control groups, respectively; 

bp^b^ * are the slopes (rate of growth per unit time) of the 

regression line predicting achievement from time for the 
program and control groups* respectively; 

tj-tj * Is 'he period of intervention. 

The difference in average performance of the program and control 

groups at the termination of the intervention can be determined as: 

«AGS - % - % - - ^c) - [(bp - b^) (t3 - t2)] . (1) 



12 

When the Xnterventlon has no effect j the equation Is: 

^ • ' ^yc) - <ap - a^) - [(bp - be) (t3 - t2)3 . 

Since the Intercepts and of the growth curves are the Initial 
achievement leyela prior to Intervention, then, " * " 
la the difference in the aiean pretest scores of the two groups. With 
tbla Substitution^ the expression CD becootesi 

% " "j-c ' " " ^^^^ ' - '2).l (2) 

The first two terms of the equation are Identical to raw gain 
scores that adjust for Initial differences In test performance while 
the second component adjusts for differential growth rates. If the 
slopes are e^ual^ I.e., the rate of growth Is the same for both groups, 
the second component equals 0 and raw gain scores provide the appro- 
priate adjustment procedure* The fan spread model, however, states 
that the growth rates are not equivalent and, therefore, an additional 
adjustment Is needed* 

The slope of a regression line Is defined as the ratio of the 
change In the vertical axlf; to the change in the horizontal axis, 
l*e., ^ ^ * using the information available before Intervention, 
the growth rate for each group can be estimated* For the program 

group, the regression slope can be written as; Mx "^*z • 

b - — E Z 

P t2-ti 

This equation Is the ratio of the change In population mean achievement 

at two points In time prior to intervention with the period of time 

between testing. SimllarXy, the regression slope for the control group 

is: Mx^ -Mz^ 

b - ~^ Sl 

P t2 - ti 
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With tl^se growth rate estimates, the third term of expression 2 can 
^ written as; 

[(bp - b,) <t3 - tjQ - f ^Xp-MZp - Mx^-Mz. \ . tj)] 

IX t2-tl t2-ti / J 

[<bp - b,) <t3 - tj)] -g pxp-yzp) Y%.-^^c> ) . ^ 



If the per:'.od of time between the first and second testing equals the 
period of Intervention t2 to t^, the previous equation can be simplified: 

[<"? - be) (t3 - t2)] - [(V^ - - (P,^ - P.^)] . 
Thus» the difference in group mean gains prior to Intervention can pro- 
vide an appropriate estimate of the difference in growth rates between 
program and control groups. The combination of this adjustment for dif- 
ferential growth rates and that for differences in initial performance 
levels results in the following estimate of treatment effects: 




where the terms are as previously defined^ 

Analysis of Covarlance with Multiple Covarlates 

The strategy presented above requires two assessments prior to inter- 
vention* Assuming this pre-treatment information is available^ a fourth 
procedure for data analysis in a quasi-experimental setting conforming to 
the fan spread hypothesis is analysis of covarlance with the two pretests 
as covarlates^ Keesllng and Wiley (1976) recently suggested a new approach 
to analysis of covarlance using multiple covarlates « Their approach, which 
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estimates the treatment effects within groups separately and then com- 
pares the magnitude of those effects across groups* may provide a reason- 
able solution to the question of fallible covariates. 

To facilitate comparisons across analytic strategies proposed for 
solving the fan spread problem* the estimate of a treatment effect can 
be written as: 

Tx T2 




— Pt t _ Pt T 



1 r,2 

1 - P Tx T2 



where : 

P and ^ correlation coefficients and standard devia*- 

tions of the subscripted true variables and; 

ibcct ^2p> are as defined previously- (The 
correlation coefficients and standard deviations of the true 
variables are estimated using replicate measures of the vari- 
ables involved.) 

While this procedure has been demonstrated on an actual data set» 
there have not been any investigations considering the distribution pro^ 
perties of the test statistic in small samples. Although further study 
of the Keesling-Wlley procedure is needed before it can be adopted as 
a competing analytic strategy^ it is being considered in this study be- 
cause the technique appears promising for the future. 
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Statement of the Problem 
Numerous educational research efforts are based on quasi-experlmen* 
tal designs^ As a result, researchers in the field often encounter dif* 
ficult problems in measuring change and estimating treatment effects^ 
Campbell (1971) argues that differential growth rates are not alvays 
explicitly recognized in quasi-experimental studies* Furthermore, he 
argues that traditional analytic strategies fail to consider differential 
growth patterns when estimaiLing treatment effects. Therefore, estimates 
of program effectlven^^ss using these strategies will be biased. 

Purpose of the Study 
The purpose of tha study was to compare four procedures in terms 
of their appropriateness as strategies for data analysis in quasi-exper- 
imental studies, given that individuals and groups may grew differentially. 
The four strategies considered were: (1) gains in standard scores, 

(2) single covariable analysis of covariance with estimated true scores, 

(3) gain scores adjusted for differential growth rates, and (A) multiple 
fallible covariable analysis of covariance« Individual growth was studied 
both in situations when the correlation between the pre-intervention and 
post-intervention measures was unity (P « 1, except for measurement errors), 
and when the relationship between the two measures was Imperfect (Pf^ 1, 
regardless of measurement errors) « This second situation arises when 
individuals begin to grow at different points in time and grow at dif- 
ferent rates, or when individuals grow academically in spurts, (These 

two situations will be referred to as Condition 1 and Conditior re* 
spectively« ) 
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The appropriateness of the strategies was based on the effects es- 
timated by each technique and the precision with which each effect was 
estimated. 

Estlmatlnp Treatment Effects and Their Standard Errors 
The fan spread growth model, as discussed earlier, suggests that 
concomitant with an Increase in mean difference between comparisons groups 
Is a proportional increase in wlthin-group variability. Furthermore, 
this relationship between the mean differences and pooled standard de- 
viation remains constant across time* Algebraically, this relationship 
is presented as: 



where the terms are as defined previously. 

This representation of the differential growth rate problem indicates 
that the appropriate adjustment strategy should be; 



Such an analytic strategy will provide an unbiased estimate of group 
differences in situations conforming to the fan spread model of growth. 
Since the definition of the fan spread hypothesis does not Include a ref- 
erence to the nature of the wlthln-group growth pattern^ the above approach 
is appropriate for both Condition 1 (P * 1) and Condition 2 (P ^ 

Estimation with Gains in Standard Scores 

The nature of the hypothesis tested by each analytic strategy is 
reflected in the respective estimates of group differences* The gains 
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In dtatidard scores approach suggested by Kenny (1975) vaa shown to esti- 
mate group differences as: 

^^GSS " % - <% - »^Xc)- 

This equation is Identical to the adjustment strategy suggested 

above based on Cantpbell's (1971) definition of the fan apread model of 

grotfth* It Is unclear whether the hypothesis was based on manifest or 

latent variables* If It Is defined on the latent true variables, then 

gains in standard scores uses the ratio of the standard deviations on the 

a 

observed variables, -J^ , when the ratio of the standard deviations of the 

ax 

true variables, "a^f desired* The relationship between the variance 
of the manifest variables and that of the latent true variables Is shown 

In the following expressions: 

2 2 
^ X - ^ Tx Pxx 

2 

y ^ Ty Pyy . 

The ratio of the standard devialtons on the manifest variables In 
t^vms of the latent true variables can be written as: 

^X ^Tjj'^Py^ 

If the reliability of the pretest equals that of the post-'test, ^xx-^yy* 
then the ratio of the observed standard deviation score is appropriate 
for the latent fan spread model i However, this ratio is an inappropriate 
adjustment coefficient for the latent fan spread model when the reliabil- 
ity of measures la not equal* Under the manifest fan spread model, the 
gains in standard scored strategy (as proposed by Kenny) is appropriate 
whether or not the reliabilities are equal* 

21 
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While the discussion liullcated the appropriate adjustment coefficient 
for the fan spread nodel Is the ratio of the population standard devla-- 
tiona for the post-test to the pretest. Kenny (1975) uses the sample 
standard deviations to estimate the ratio. The expected value of the 
ratio of the sample standard deviations, however, does not equal that of 
the population standard deviation, E(Sy/Sx) t^^y/^^ f when the samples 
are small* The effect estimated using Kenny's technique, therefore, is 
not the desired one when sample size is smaXl« The gains in standard 
scores approach is not affected by the relationship among individuals with* 
in the comparison grcnips. For large samples then, the technique can be 
used to estimate the appropriate effect for both models of vithin-group 
growth. 

Estimation With True Score Analysis of Covariance 

A aecond solution to the fan spread model proposed earlier is the 
analysis of covariance model using estimated true scores as the covariate. 
This approach estijuates group differences as; 

^ Pxx Oat *^ 

This strategy Is Identical to the adjtistment strategy suggested by the 
fan spread definition, except for the Pxy/fjcx ratio, which corrects for 
measurement errors. If the true relationship between the two measures 
Is perfect as proposed by Condition 1, the ratio of the correlation to 
the reliability of the covariate will also equal unity. Thtis the analysis 
of covariance model with estimated true scores provides an appropriate 
adjustment for fan spread In Condition 1. 

Previously, a distinction was drawn between the manlfeat and latent 
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fan spread models. Considering the latent model, the relationship between * 
the adjustsent coefficient provided by estlmateil true score analysis of 
covarlance and the ratio of the latent variable standard deviations can 
be written as: 

Pxx *^x "Tj^ • 

The above expression Is true i^en the reliability of the pretest and post- 
test Is equal for the linear model of vlthin^group growth. If the reli- 
abilities are not equal, then the following relationships show that the 
appropriate adjustment Is still provided by the procedure: 




This last expression equals the ratio of £:he latent standard deviations 
when the linear model of wlthin-group growth is accurate. If the manifest 
fan spread model is assumed, then the effect estimated by the true score 
analysis of covarlance strategy is appropriate only when the reliabilities 
of the pretest and post-test are equal. 

Under Condition 2, the true relationship between the pretest and 
post-test does not equal unity even when measurement errors are corrected. Thus, 
In this situation the strategy under-adjusts for initial group differenced* 
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Eatlaatlon with Adjuated Gain Scores 

The third analytic strategy proposed to ^juat for differential growth 
rates in the adjusted gain score strategy. The following Illustrates the 
strategy for estimating group differences; 



This expression can be simplified when the period of time betveen 
the first and second pretests ('l~'0) equals t. t period of intervention 
(':2-'=l): 

The utility of the effect estimated is denoostrated for the fan spread 

data by showing that otASS ** ^* Assume that the difference between the 

two group means on the X variable equals some constant (a), ^Xj.^a 

and the difference between the group means on the Y measure equals 

( a + b), where b is any constant, *^yp-^yc « a + b. For fan spread data 

and equally distant time points t the difference between the group means 

on the Z measure would equal a - b; thus, ^zp-^z^, a-b. The effect 

estimated using the adjusted gain score strategy can be written as: 

«AGS " Vyp-^yc'2i^^p'^y^)+0'zp-V2c) 
a + b - 2(a) + (a-b) 

- 2a - 2a 

- 0. 

The adjusted gain score procedure does not requre equal time periods 
between test administration. Ve can adjust for differences in time periods 
for the group's using the ratio of time under Investigation to the time 
between the first and second pretests. Since adjusted gain scores are 
only a function of means and unaffected by measurement errors, the 

2.i 
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procedure Is appropriate for both manifest and latent fan apread models* 
Finally^ the adjtisted gain score atrategy is not influenced by the model 
of vithin-group growth; therefore^ it is appropriate for both Condition 1 
<P « 1) and Condition 2 ( P )( 1) of the fan apread hypothesis. 

Eatlination with Multiple Fallible Covariatea 

The final strstegy suggested to adjust for differential growth rates 
between comparison groupa ia the analyaia of covariance model vith multiple 
covariatea. The multiple covariatea are the double pretest data collected 
prior to intervention. Following the Keesllng-Wiley (1976) procedure m 
estimate of the group differences ia stated aa; 



On the surface this estimate differs considerably from that suggested 
by the fan spread model definition. So> the nature of the coefficients 
must be examined. For Condition It the relationship between the test 
performances wassaid to be perfect^ P " 1. If we asstmie this is true^ then 
the following also applies; 



But the denominator in these adjustment coefficients is 1 - ^T^T^- 
Iff ss Condition 1 suggests^ the true relstionship between test perfor- 
mances is perfect t then denominators in these coefficients are zero^ and 
the coefficients are undefined. The Keesllng-Wiley spproach is Inappropriate 
for Condition 1 when the covariates are repeated adminiatrations of the 
same or parallel forms of the post^test messure. 

Condition 2p however » suggests thst the relationahlp between teat 



*^c " ^yp-^yc- 



Pm m Pm m Pt T 




1 - T 



PTxTy-PTKTz-PT^Ty-l. 
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8core« across time Is not perfectt P 1^ 1* Under this coiulltiontthe ad- 
justment coefficients suggested by the analysis of covarisnce strategies 
are defined. It is necessary then to determine whether or not the co* 
efficients provide the appropriate adjustment* To use the Ksesllng-Wlley 
procedure under Condition 2 of the fan spread models the following equality 
nmst exist! 



P 



yx-PxzPzy ^y (%-^Xc)- ^Pzy-PxzPxy ^y(^Zp-^Zc>f2:<%'^'c) 
i o2 a~ 1 o2 a 

where; 



correlation coefficients (P) and the variances (o) are 
expressed in terms of the latent true variables* 

The fan spread model defines the difference between the group means on 

the Z variable as; 



The Keesling-Wlley coefficient can then be written as: 
1 - P^xz ''x 1 - p2xz ^'x 



a 

X 



[Pyx-PxzPzy + Pzy-PxzPxyT 
.1 - P^xz 1 - P2xs J 



For the K ^sling-Wiley procedure to be appropriate, the third factor In 
the expres .on must equal unity; 

Pxy-PxjPZy + PZy-PXjPxy * 1, 

1 - P^xz 1 - P^xz 
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This strategy may be rewritten as: 
"xy + "zy - "xz 

or 

(Pxy + Pzy) (1 - Pxz) • 1 - P^XZ . 

Further simplification/of the equation Is provided by noting that: 
^ " P^xz - (1 - ^'xz) (1 + "xz) . 
Thus, under the second model of vithln-group growth, the expression 
(^'xy + "^y) « <1 + "xz) Is essential before the Keesllng-tftley proce- 
dure can appropriately adjust for fan spread. This equality only exists 
when both ^xy and "zy are greater than Since ''zy involves 

variables measured at two points farther apart in time than '^z, this equal- 
ity is highly unlikely. Therefore, the Kees ling-Wiley procedure is an 
inappropriate solution to the fan spread model* 

Sunanary 

Examination of group difference estimates by the four analytic 
strategies shows that for Condition 1 ■ 1), gains in standard scores, 
analysis of covarlances with estimated true scores of the covarlate, and 
adjusted gain scores all estimate the effect of interest. Only the 
Keesling-Wiley (Note 1) analysis with double pretests as covariates pro- 
duces the wrong effect estimate. For Condition 2 (P ^ 1), only the gains 
in standard scores and adjusted gain scores estimate the desired effect. 
ThuSf researchers can select an analytic strategy in both Conditions 1 
and 2 of the fan spread model. Based on these findings, selection of 
one technique over another might be based on strategy precision. 
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Precision 

The precision of an analytic strategy Is defined in terms of the 
standard error of the contrast, which. In turn. Is determined by the 
fluctuation of the adjusted variable* Therefore, a comparison of standard 
errors associated with each strategy provides a means of assessing the 
precision of each technique* 

Each analysis strategy considered can be conceptualized In terms 
of an adjusted dependent measure^ When comparing a program group with 
a control group^ the contrast of interest Is the difference between the 
means of the two groups on the adjusted variable* The standard error is, 
therefore, the square root of the variance of this contrast 
The variance of the contrast Is defined as: 

Var(Wp-^Wc) - Var(Wp) + VaT(\) - 2CoviV^,V^). 

To determine the standard error of the contrast, both the variance 
and the covarlance of the adjusted means are needed^ All analytic strat- 
egies considered reseinble this form and differ only In the approach used 
to define the adjusted variable, W. The adjusted variable for both the 
gB±n In standard scores and the analysis of covarlance model with estimated 
true scores of the covarlate appear as: 

W « Y - ICX 

where: 

X and Y are the pretest and post-test scores, respectively, and K 
Is Che adjustment coefficient* 

Using the gain in standard scores approch, the adjustment coefficient 
is the ratio of the standard deviation of post-test to pretest, K « f y ^ 
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Thfi true score analysis of covarlance strategy defixies the adjustment 
coefficient as the ratio of the pooled vithin*^roup regression slope and 
the pretest reliability coefficient^ 0^ . The sdjusted variable for 
the adjusted gain score approsch la: 

where: 

Z» X^and Y are the first pretest^ the second pretest administered 
just prior to treatment^ and the post-tesf^ respectively* 
Since the Keesllng-Wlley (1976) procedure is Inappropriate for the fan 
spread model » the standard error assoclsted with that technique Is not 
considered* 

Tsble 1 summarizes the standard errors associated with the three 
competing snalytlc strategies (see Olejnlk^ 1977}* The formulas presented 
in Table 1 indicate thst the ststujard errors of the analytic strstegles 
considered are determined by a combinstion of four components. The 
first three components involving the variance of the post-*test» the 
variance of the pretest^ and the covarlance of the pretest and post-test 
are Included in all three sLsndard errors* Standardized gains and anslysis 
of covarlance with estimated true scores measure the squared difference 
between the population means in the fourth component* The fourth com^ 
ponent of the adjusted gain score strategy determines the varlsnce of the 
first pretest and the covarlance of the first pretest with the second pre* 
test and the post-test. Since the three standsrd errors are determined by 
bssicslly the same components » differences in strategy precision can be 
explslned by differences in the coefficients of the four components. 

The first component of esch standsrd error is identical for ^11 three 
analytic strategies with 1 ss the coefficient of the post-test vsrlsnce 

29 
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Table i 

The Standard Errors Associated With Gains In Standard Scores, True 
Score Analysis of Covarlance, and Adjusted Gain Scores 



Standard error for gains In standard scores: 



Var (Y) + 



Var (X)-2E =i Cov(X,Y) 



Standard error for analysis of covarlance for estimated true scores of the covarlate: 





* 

I* 




Var (Y) + 




L 
■ 



{Y)+ ^ S""' * .y'^ Var(X)- 



2 — i^Cov (X.Y) 



XX 



Var (b ) 
*(^xp-^xc)^-^^ 



Pxx 



standard error for adjusted gain scores: 



^||var{Y) + ^l+|jvar (X).^2+|^Cov (X.Y) j + ^Var (Z) +2Cov (Y,Z) - 4 Cov.(X,Z) 
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term. The coefficients of the last three componentB* however differed 
considerably* ^Both gAina in standard scores and eatijxiated true score 
analysis of covarlance strategies determine these coefficients using 
the expected value and variance of their respective adjustment coef ficienta. 
But the adjuated gain score approach determinea the coefficient of the 
last three components based solely on sample aize« 

Tables 2 through 7 were compiled using expected values and variances 
of adjustment coefficients ^ en the variancea of the pretest and poat-test 
are equal, (For ccnaplete derivations of these valuea aee Olejnikt 1977.) 
Expected values and variances were derived for different sample sizea 
and relationahips between the pretest and poat-teat meaaures from the 
theoretical denaity functions of the adjustment coef f icienta. The fan 
spread model assumes increasing variability from pretest to po8t*-test« 
This aaaunrptio n^ has the effect of increasing the expected value and vari^ 

ance of the adjustmeiHS^coeff icienta by a factor of the population poat- 

\ « 2 

test to pretest variance ratiOt-^Spr * 

Generally^ the greater the difference between the two variances^ the 
larger the atandard error is for both the gains in standard score approach 
and the estimated true gicore analysis of covariance technique. The mag- 
nitude of the increaae in the standard errora ia the same for the two pro- 
cedures- In comparing the precision aasociated with these two strategies* 
the coefficients found in Tablea 2 through 7 provide a reasonable basis 
on which Judgments can be made« The adjusted gain acore approach is not 
affected by the fan spread assumption. Therefore* the atandard error 
estimated from the coefficients preaented in these tablea remains the 
same regardlesa of the difference between the variance of the pretest and 
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Cixfflclefits for the Second, Third, umi Fourth Ccnponents of the Standard Error Assocfated Hith the Th:w Coasting Analytic 
Strategies Mhen p • .9 for the Manifest Variables and the Population Variance of the X and Y Va/lables Arc £qua1 



Second conponent Var (X) 



Third ccotponent Cov {X.Y} 



Fourth component 



m 



Gains In 
standard 
scores 

2 



+ 0 



Analysis of 
covariance 



Adjusted 
gain 
scores 



Gains in 

standard Analysis of 
scores covarlance 



Adjusted 
gain 
scores 

^4 



Gains In Aciju^ttd 
standard Analysis of 9<1n 
scores covarlance scones . 



XX 



'S /S 



yx 



2 

1? 



20 
40 
60 
80 
100 



1.02228 
1.01036 
1.00674 
1.00486 
1.00396 



1.01380 
1.00634 
1.00411 
1.00428 
1.00242 



1.1S000 
1.07500 
1.0SOOO 
1.03800 
1.03000 



2.01100 
2.00520 
2.00340 
2.00240 
2.00200 



2.00000 
2.D00OO 
2.00000 
2.00000 
2.00000 



2.10000 
2.05D00 
2.03333 
2.02500 
2.02D00 



.01125 
.00514 
.00334 
.00246 
.00196 



.01380 
.00634 
.00411 
.00428 
.00242 



.00500 
.00125 
.00055 
.O003'f 
.00020 



Table 3 



Coafflcttnts for the Second, Third, and Fourth Conponents of the Standard Error Associated Vlth the Tlirat CoMptttni Amlytlc 
Strategies llhen p • .8 for th€ Ksnlfest Variables and the Population Variance of the X and Y Variables Are E^al 



Second conponent Var (X) 



Third ccn^nent Cov (X,Y) 



Fourth component 



Gains In 
standard 
scores 



Analysis of 
covarlance 



Adjusted 
gain 
scores 



Gains In 
standard 
scores 

S. 



Analysis of 
covarlance 



Adjusted 
gain 
scores 


Gains In 
standard 
scores 


Analysis of 
covarlance 


Adjusted 
gain 
scores 






"b /Pix 
y»x 


2 

n»" 


2.10000 


.02143 


.03309 


.00500 


2.05000 


.00978 


.01520 


.00125 


2.03333 


.00634 


.00968 


.oooss 


2.02500 


.00468 


.oom 


.00031 


2.02000 


.00372 


.00610 


.oono 



20 
40 
60 
80 
100 



1.04233 
1.01940 
1.01255 
1.00428 
1.00752 



1.03309 
1.01520 
1.00968 
1.00731 
1.00580 



1.15000 
1.07500 
1.05000 
1.03800 
1.03000 



2.02080 
2.00960 
2.00620 
2.00460 
2.00380 



2.00000 
2.00000 
2.00009 
2.00000 
2.00000 



Table 4 



CMfflcltnts for the Second, Third, and Fourtfi Cmponents of the standard Error Assoclatad Vlth tht Thr«a CfiMfwtlng AMiytIc 
Strategfes When g • .7 for the ^(atilfest VaHables and the Populetlon Variance of the X and r Variables Are Equal 





Second conponent Var (X) 




Third cOBpcnent (X,Y) 


Fourth coiponent 


n 


Gains In 
standard 
scores 


Analysis of 
covarlance 


Ailjusted 
gain 
scores 

1^ 

n 


Gains In Adjusted 
standard Analysis of gain 
scores covarlance scores 


Gains In Adjutttd 
standard Analysis of gain 
scores covarlance scores 



20 


1.05489 


1.06T22 


1.1S00O 

<w 


2.0£420 


2.00000 


2.10000 


.03049 


.06122 


.00500 


40 


1.0Z7S3 


1.02813 


1.07&00 


2.01360 


2.00000 


2.05000 


.01388 


.02813 


.00126 


60 


1.01781 


1.01826 


1.O500O 


2.00860 


2.00000 


2.03333 


.00898 


.01826 


.ooos« 


80 


1.01324 


1.01352 


1.03800 


2.00660 


2.00000 


2.02500 


.00663 


.01352 


.00031 


100 


1.01048 


1.01O73 


1.O300O 


2.00520 


2.00000 


2.02000 


.00527 


.01073 


.00020 



Table 5 

CMfffclenU for the Secondi Third, ami rourth Conponents of tht standard Error Associated Kith the THrat Cnpetlay AMIytIc 
strategies When p • .6 for the Manifest Variables and the fopulatlon Variance of the X and r Variables Are Equal 



Second component Var (X) 



Third component Cov (X,Y) 



Fourth coaiponent 



Gains In 
standard 
scores 



Analysis of 
covarlance 



Adjusted 
gain 
scores 



♦a 



• J Vi 



Gains In 

standard Analysis of 
scores covarlance 



Ailjusttd 
gain 
scorts 

2*1 



Sains In Adjested 
sundard Analysis of gain 
scores covarlance scorts 



1 



20 


1.07S33 


1.10458 


1.15000 


2.03660 


2.00000 


2.10000 


.03839 


.10458 


.00500 


40 


1.03452 


1.04805 


1.07500 


2.01700 


2.00000 


2.05000 


.01745 


.04805 


.00125 


60 


1.02252 


1.03119 


1.05000 


2.01120 


2.00000 


2.03333 


.01129 


.03119 


.0MS6 


80 


1.01655 


1.02309 


1.03800 


2.00820 


2.00000 


2.02500 


.00833 


.02)09 


.00031 


100 


1.01323 


1.01833 


1.03000 


2.00660 


2.00000 


2.02000 


.ooett 


.OltM 


.oooto 



Table 6 



CoifflclCfiU for the Secoml, Third, and Fourth CQnfKMmits of the SUndard Error Associated Kith the ThiM Comtfiit AMiytIc 
S^tegles When p » .5 for the Hanlfest Variables end the Population Variance of the X end Y Variables >i« Equel 



Second component Ver (X) 



Third component Cov (X,y} 



Fourth component 



Sains In 
standard 
scores 



Analysis of 
covarlance 



Adjusted 
gain 
scores 



Gains In 
standard 

scores 



Adjusted 
Analysis of g«ln 
covarlance scores 

2 2-5- 2 + # 



Gains In AdJusttd 
standard Analysis of filn 
scoffs covarlance scores 



20 


1.08818 


1.17647 


1.15000 


2.04260 


2.00000 


2.10000 


.04513 


.17647 


.00500 


40 


1.04058 


1.O8108 


1.07 500 


2.02000 


2.00000 


2.05000 


.02048 


.08108 


.00125 


60 


1.02628 


1.05432 


1.05000 


2.01300 


2.00000 


2.03333 


.01325 


.05432 


.00056 


80 


1.01939 


1.03895 


1.03800 


2.00960 


2.00000 


2.02500 


.00978 


.03896 


.00031 


100 


1.01523 


1.03093 


1.03000 


2.00760 


2.00000 


2.02000 


.007613 


.03093 


.00020 
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Table 7 

Coefficients for the Setond. Third, and fourtti Cottponents of ttM Standard Error Associated Kith the Three Co«Mt1ng Analytic 
Strategies When p - .4 for the Manifest Variables vtd the Population Variance of the X tnd Y Variables Are Equal 



Second component Var (X) 



Gains In 
standard 
scores 

il3 



Analysis of 
covarlance 



Adjusted 
9a1n 
scores 



Third component Cov (XiY) 

Gains In Adjusted 
standard Analysis of 9^in 
scores covarlance scores 



Fourth component 



Gains In Adjuftod 
standard Analysis of ftfn 
scores covarlance scores 



^4 



sys„ 



4 /pj^ 

y'X 



2 



20 


1.09883 


1.30883 


1.15000 


2.04760 


2.00000 


2.10000 


.05066 


.30883 


flflfiflO 




40 


1.04549 


1.14189 


1.07500 


2.02240 


2.00000 


2.05OO0 


.02296 


.11419 


.0B12S 




60 


1.02949 


1.09211 


1.05000 


2.01460 


2.00000 


2.03333 


.01485 


.09211 


.00056 




80 


1.02179 


1.06818 


1.03800 


2.01080 


2.00000 


2.02500 


.01096 


.06818 


.00031 


o 


100 


1.01732 


1.05412 


1.03000 


2.00690 


2.00000 


2.02000 


.00869 


.05412 


.00010 
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post**test. 

The first' three tables (2, 3, And 4) present coefficients for 
situations when the correlations betveen measures are high (P^«7)* 
In these situations, only minor differences are apparent between the coef- 
ficients defined by the three £^i:rategles for the three components. Further* 
nore^ this result Is consistent for both sntall and large samples. Coef- 
ficients for the fourth ctmpanent may demand special attention, lAien the 
relationship between the measures Is high, the coefficients associated 
with the fourth component appear very small. For practical purposes 
these coefficients are essentially zero. Thus* the standard errors for 
the three strategies under consideration are determined by a combination 
of the post-test variance* pretest variance* and pretest-post-te^t covarl* 
ance components when the tuo measures are highly related and the pretest 
and post-test variances are equal. 

The second three tables (5« 6, and 7) present coefficients for situ- 
ations when the correlation between measures Is low (P <,7), The coef* 
flclents assoclatec^ with the second and third components again appear 
basically the same for each strategy. As sample size Increases^ the mag* 
nltude of the coefficients decreases therefore reducing the standard error 
and Increasing test precision. 

The coefficients associated with the fourth component can no longer 
be Judged equal across the three competing strategies. The coefficients 
for the fourth component of the adjusted gain score strategy are unaffected 
by the relationship between the measures and thus remain essentially zero. 
But the coefficients for gains In standard scores and estimated true score 
analysis of covarlance are Inversely related to the relationship between 
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the measures. That 1«» the coefficient Increases as the relationship be- 
tween the measures decreases » 

The effect of this relationship Is greatest In small samples* As a 
result of the increase^ the fourth component of the standard error formula 
for these two procedures Is no longer zero» Thus» In comparing the precl* 
slon associated with the three strategies, the adjust^ gain acore procedure 
provides the smallest standard error when the relationship between the 
measures Is low» 

The coefficients presented in Tables 2 through 7 were determined for 
situations when the variance of the pretest equalled the variance of the 
post-test» The fan spread model suggests, however, that variance Increases 
with tlme» This assumption of the fan spread model does not effect the 
standard error associated with the adjusted gain score strategy^ This 
technique Is Influenced only by the size of the sample studied » 

The precision associated with the adjusted gain score approach Is* 
therefore, the same as that discussed above» The standard errors of the 
gains In standard scores and true score analysis of covarlance are affected 
by the fan spread assumption^ Further variability predicted by the fan 
spread model Increases both the expecf:ed value and the variance of the 
adjustment coefficient suggested by each procedure^ This, In turn, In*^ 
creases the coefficients of the three components discussed previously^ 
Thus the fan spread assumption of Increasing variability results in de- 
crease In strategy precision and a larger standard error than when the 
variability Is constant across time. 

In comparing the three competing analytic strategies under the fan 
spread model, then, greater precision Is achieved through the adjusted gain 
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score procedure than either saine In standard scores or true score analysis 
of covar lancet Furthermore, the difference In precision increases as the 
sample size and the relationship bittveen the pretest and post-*test measures 
decreases. Strategy precision will also vary with fan spread, e*g., the 
greater the fan spread, the greater the difference In precision. 

The above discussion comparing the standard errors of the gains in 
standard scores approach with the estimated true score analysis of covarl-* 
ance approach was based on the false assumption that the standard error 
associated with the procedure suggested by Kenny (X975) has the form pre- 
aented in Table X. In actual practice this Is not true. 

The computed standard error can be easily derived from a description 
of how the gains in standard scores were determined. Kenny suggests a 
two stage process: first determine the pooled standard deviation of the 
scores at time X and time 2; then adjust the respective observed scores 
with the results from step 1 and take the difference between the two ad^ 
justed scores* This difference will be the dependent variable in the 
analysis of variance model. 

It is assumed in this procedure that the adjustment coefficient deter* 
mined in step 1 is theoretically correct. Assuming the adjustment coef- 
ficient computed on the sample data is constant* the same ^efficient would 
be obtained if a second sample were drawn from the populatlonr Based on 
this assumption the standard error becomes; 

/2 Var(Y) + fjt Var(X) -2 ^ Cov(x,y). 
" S2x 
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The conputed standard error Is different frcm the theoretically correct 
standard error presented In Table 1 by eliminating all factors Involving 
the varlablllCy of the adjusCmenC coefficient. Ignoring the fact that the 
adjustoent coefficient can vary from sample to sample results in an under-- 
estimate of the correct standard error« This reduced form of the standard 
error produces spurious precision and leads to a liberal test of the hypo- 
thesis under investigation. 

The degree to which Kenny ^s <1975) procedure is Inappropriate depends 
on the actual variability of the adjustment coefficient. When the relation'^ 
ship between ths pretest measure and the post'-test measure is high and the 
sample size is large* the variability of the adjustment coefficient is 
essentially zero. Under those conditions the procedure suggested by Kenny 
is likely to be appropriate. In smaller samples ^ and when the relationship 
between measures la low» the probability of error associated with Kenny* s 
technique increases « 

The second conceptualization of within-group growth proposed for the 
fan spread model suggested that individuals may not grow linearly. Instead* 
they may grow at varying rates or in "spurts" across tlme« As a result^ 
the relationship between the pretest and post-test measures would be less 
than unity without considering measur^ent errors. Using this model* two 
analytic strategies — gains in standard scores and adjusted gain scores 
achieved the desired estimates. The discussion presented earlier concerning 
the respective standard errois for these procedures provides the basis on 
which the selection of one of these approaches can be made. 

The coefficients for the adjusted gain score strategy were shown earlier 
to be influenced only by the sample size under study. Therefore* changing 



35 

the conceptualization of vithln-group growth does not affect the direction 
of the adjusted gain score strategy* The standard error associated with 
this procedure Is the same for the traditional as veil as tha second con- 
ceptualization of the fan spread wl 1* The precision of the strategy 
using gains in standard scores* hovevery Is Influenced by the relationship 
between tb%, pretest and post-test measures* 

The previous disctission concerning this relationship indicated that 
as the correlation between the laeasures decreased^ the standard error for 
the gains in standard scores increased* Conceptualizing within-group 
growth as non^llnear reduces the relationship between the pretest and post- 
test measures beyond that due to errors of measurement. Thus the preci- 
sion of this procedure is reduced under the second icodel of the fan spread 
hypothe:>:ls* A comparison of the precision provided by the adjusted gain 
score approach and the gains in standard scores procedure indicates the 
former is the more desirable strategy* 

In addition^ a previous discussion of the computed standard error for 
the gains in standard scores demonstrated that this technique provided a 
liberal test of the hypothesis under investigation* The liberalness of 
this procedure depends on both the sample size and the relationship be- 
tween the pretest and the post--test measures* Since the second model of 
the fan spread hypothesis results in a reduced relationship between the 
measures » the problem of a liberal test of the hypothesis is more acute in 
this conceptualization than in the traditional approach* 

Although both adjusted gain scores and gains in standard scores test 
the appropriate hypothesis^ results indicate that the former procedure 
provides a more powerful test of the hypothesis and is the more desirable 
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analytic strategy. If data from two pretests vere not^^^ro^^ble, only 
the gains in standard scores approach tested the appropriate hypothesis. 
This technique, however, vas shown to provide a liberal test of the hypoth* 
esla« Vhen thl& procedure is used, the results of the analysis must be 
interpreted cautiously. Nevertheless, a correct procedure is available 
for the standard error developed in this study. 

Conclusion 

For the fan spread hypothesis under both Condition 1 <p » 1) and 
Condition 2 <P 1^ 1), th9 findings indicated that the most desirable analy- 
tic strategy of those considergd is adjusted gains. This approach tested 
the correct hypothesis under both 'luodels of the fan spread condition and 
with greater precision than competing analytic strategies. When only a 
single pretest perfonnance was available, estimated true score analysis 
of covariance vas shown to be a isore desirable strategy than gains in 
standard scores. This conclusion was limited only to the traditional con* 
ceptuallzation of Che fan spread model* 

However, when (1) the variance of the measures are equal, (2) the re- 
latirnshlp between pretest and post«test is highland <3) the sample la 
large, the two procedures estimate the desired effect with equal precision. 
Finally, when only a single pretest is available and Che second model of 
the fan spread hypothesis is appropriate, only the gains in standard scores 
procedure eatlmates the desired effect. Of the four analytic strategies 
considered In this study, only the multiple covarlate analysis of covariance 
as suggeated by Keesllng and Wiley (1976) was rejected as an inappropriate 
technique for any condition of the fan spread hypothesis* 
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Limitations 

The adjusted gain score procedure was presented as an appropriate 
analytic strategy for situations conforming to the fan spread model. To 
focus attention on what were considered to be the central points for comr* 
parison, some assumptions about the circumstances of application were niade» 
A basic assumption was that it is possible to measure the same individuals 
repeatedly on the same variable » This assumption may be difficult to meet 
in a real world settings In schools, both the administration and teachers 
require repeated testing to monitor student progress. These tests, how^ 
ever, may not be appropriate for the adjusted gain score approach since 
they are unlikely to be the same test or a parallel form of the test. 
With careful^ planning^ repeated testing of individuals with parallel forms 
of a test may be possible^ 

A second assumption was that there are no selection by regression 
or selection ^t^cfit^i^ interactions. If these distortions of the group^s 
growth rate affect both groups equally, then an estimate of group differences 
is not affected^ For example, if testing effects equalling (a) units on 
the X measure exist and this distortion is the same for both groups, then 
the estimate of the group difference using the adjusted gain score pro- 
cedure could be written as: 

"yp-V- [(''xp+a)-(''x^+a)] - [(''xp+a-''zp)-(''xe+a-''-c)] 

- "yp-^c- [("xp-^xc) + (a-a)] - |l''xp-''^p) - Cxe-^Ze) + (a-a)^ 

As long as the distortions affect both groups equally, estimates of 
group differences are still appropriate. The selection by regression or 
testing Interactions refer to the distortions affecting one group to a 
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greater extent then the other group* If this assumption Is violated* then 
the estimated group differences are inappropriate. 

Finally » the adjusted gain score strategy was based on the assumption 
that groups grow in a linear fashion* This asstnaptlon is likely to be tnet 
in situations Involving short time periods* Over extended time periods 
It seems less likely that a linear model would adequately characterize 
group changes* The estimated true score analysis of covariance and gains 
in standard scores strategies also make the same assumption about linear 
growth* These procedures use data obtained over a shorter period of time 
than adjusted gali^cores and are less likely to violate the assumption* 



Vfhen the assumption is violated^the adjustment provided by the adjusted 
gain score strategy can be totally inappropriate* Tbus« the use of the 
adjusted gain scores may not be appropriate in situations where the Inter* 
ventlon period Is extensive* 
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